REPORT  DOCUMENTATION  PAGE 


f orm  Approved 
OMB  No  0704  0188 


Public  b<j*'dr‘^  ^Of  ch<s  <oH<r<tiO^  lO  *  ►'Oor  or^r  <«rvc>on\c.  metodirtg  the  fO^  1-^%*  f  ucliOn\_  %c<»^Ch*nq  r«'%t<nq  d4(4  VCK/r<<-i 

gatK^fjoq  Acxi  th^r  datj  ^v^^<^d.  4nd  COmp<eti«v'j  jrvd  f«>v.<>w<nq  tb<*  COllfTHOn  0<  «rtfO‘’‘«4tion  ^md  cO'T<<T\cnt\  frgjrd'f^g  th*\  bufdrn  CK  *riy  otf'-rf  4U>CCt  oi  tht\ 

CoM^<l<Oo  Qi  mclodtruj  \»jg9<nt*Onv  iof  frduemg  |h(\  bu/d*-^  to  W4\h.rKjtOn  Hr^dQujrtcr^  ^c<vKe\,  0.^cCtO<^4{<r  lo^  inlO'<^4t*on  Oof ' 4t'On\  4nd  Reoof t\.  1 2  1  S  icMcrvxi 

04vi%  Highway.  Su'tf  120-3.  Af  (<og  tO'^.  VA  222Q2'4)Q2.  4(vJ  lo  ft'f  o'  Ma«4qvmr''l  Budget .  P^oe*- wq/V  t<o^  P<’0|e^  I  (0  20-30588).  W^thmqto*'.  OC  20  SO  3. 


1.  AGENCY  use  ONLY  (LeJve  blank)  2.  REPORT  DATE 

10/11/94 


4.  TITLE  ANO  SUBTITLE 


Workshop  on:  Diffusion  AppSjijximations  in  Communication 
Sc  stochastic  Systems  Theory 


3.  REPORT  TYPE  ANO  OATES  COVERED 

Final  Technical  Report.  6/1/93-5/31/94 


S.  FUNDING  NUMBERS 

F49620-93-1-0279 


6.  AUTHOR(S) 


Prof.  Paul  Dupuis 


7.  PERFORMING  ORGANIZATION  NAME(S)  ANO  AOORESS(ES) 
Bro^srn  University 
Division  of  Applied  Mathematics 
182  George  Street 
Providence,  RI  02912 


9.  SPONSORING/MONITORING  AGENCY  NAME(S)  ANO  AOORESS{£S) 

AFOSR  III  I-  ^ 

110  Duncan  Avenue,  Suite  bll5 
Bolling  AFB,  DC  20332-0001 


8.  PERFORMING  ORGANIZATION 
REPORT  NUMBER 


AFOSRTR-  y  i)  “  0  I  9  0 


10.  SPONSORING/MONITORING 
AGENCY  REPORT  NUMBER 


WiciL^iyi-cyr/ 


12a.  DISTRIBUTION /AVAILABILITY  STATEMENT 


dicti  iiv.iion  vLiir, 


13.  ABSTRACT  (Maximum  200  wards) 

The  workshop  "Stochastic  Systems  and  Their  Applications"  was  held  in 
Newport,  RI  on  A.pril  15  &  16,  1994.  The  main  topics  of  - the  conference 
were  asymptotic  methods  in  stochastic  systems  theory,  and  related 
applications.  The  goal  of  the  conference  was  to  review  recent  advances 
in  asymptotic  methods  and  expose  some  important  new  application  areas 
where  those  methods  might  be  useful. 


19950403  049 


14.  SU3IECT  TERMS 


15.  NUMBER  OF  PAGES 


16.  PRICE  CODE 


OF  REPORT 

vA  di /-..■•  -k-iA,  .-i 

-1 '  ‘  ‘v. '/  ^  \  '  i'C  \ 

;SN  7540  oi'.'io  ^S'OO 


18.  security  CLASSIFICATION 

19.  SECURITY  CLASS.'FlCA  TlON 

OF  Tins  PAGE 

OF^.ABSTRACr 

UGC  i-iSSi  M  di 

title! 

S'. 

~')U/ 


THIS  DOCUMENT  IS  BEST 
QUALITY  AVAILABLE.  THE  COPT 
FURNISHED  TO  DUC  CONTAINED 
A  SIGNIFICANT  NUMBER  OF 
PAGES  WHICH  DO  NOT 
REPRODUCE  LEGIBLY. 


Stochastic  Systems  and  Their 
Applications 


Newport  Marriott  Hotel 
25  America’s  Cup  Ave. 

iNCV'.pUll,  XCX 

April  15  cC  16,  1994 


Conference  sponsored  by  Air  Force  Office  of  Scientific  Research 

Grant  Number:  F49620-93-1-0279 


The  workshop  ‘Stochastic  Systems  and  Their  Applications”  was  held  in 
Newport  RI  on  April  15  k  16  of  1994.  The  main  topics  of  the  conference  were 
asymptotic  methods  in  stochastic  systems  theory,  and  related  applications. 
The  goal  of  the  conference  was  to  review  recent  advances  in  asymptotic  meth¬ 
ods  and  e.xpose  some  important  new  application  areas  where  these  methods 
might  be  useful. 

Each  day  was  divided  into  two  parts.  In  the  morning  talks  of  a  more 
theoretical  nature  were  given,  while  the  afternoon  was  devoted  to  applica¬ 
tions.  The  main  application  areas  discussed  were  from  communications  and 
manufacturing. 

On  the  more  theoretical  side  there  were  talks  by  T.  G.  Kurtz  and  A.  D. 
Wentzell  on  a,pproximations  via  stochastic  averaging  and  asymptotic  expan¬ 
sions  of  functionals  of  Markov  processes,  respectively.  M.  Zakai  spoke  on 
error  bounds  in  nonlinear  filtering,  while  R.  Khasminskii  reported  new  work 
on  methods  of  stabilizing  solutions  to  stochastic  differential  ecjuations. 

iiic  taiKS  uy  I.  Karatzas,  ai.  Reiiiiaii  auu  L  Ljuug  uere  uf  a  mure  appiieu 
nature.  Karatzas  described  recent  work  on  dynamic  allocation  when  the 
pro!:i!em  had  !;)ecn  formulated  as  a  bandit  problem.  Ih'irnan  discussed  various 
liea'.'v  trafRc  limits  for  Mau'kov-modulated  ciueues,  which  are  the  sort  tliat  ap- 

a  general  talk  on  recent  work  on  the  tracking  ability  of  adaptive  algorithms. 

Th'^  ''OTiKr(=;ire  ■was  rounded  ou*'  bv  twn  talk'=  oi"!  ?pnhr?,tinns  th.at  ave 
currentl}'  of  great  interest.  D.  Mitra  discussed  asymptotic  methods  in  the 
analysis,  design,  and  control  of  high-speed  communication  networks.  P.  R. 
Kumar  considered  a.pproximatiou  methods  lor  Cjueueiiig  systems.  The  liign- 
light  of  his  ta.lk  was  a  new  method  for  controlling  re-entrant  line  queues,  and 
an  application  of  the  methods  to  semi-conductor  manufacturing. 
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ABSTRACTS 


Tom  Kurtz 

Department  of  Mathematics 
University  of  Wisconsin 

480  Lincoln  Dr. 

Madison,  WI  53706 

Averaging  stochastically  perturbed  Hamiltonian  systems 


A  classical  problem  in  the  study  of  mechanical  systems  is  concerned  with 
the  behavior  of  such  systems  in  the  presence  of  nearly  rigid  constraints.  A 
system  of  this  type  can  be  modeled  as  follows.  Let  U,  W  £  C'^{1R^).  Assume 
that  IV  >  0  and  that  M  =  {x  £  LR.'^  :  =  0}  is  an  77:-dimensional 

manitold  with  m  <  d.  The  model  is  then  given  by  the  Hamiltonian  system 
AT  =  —  Vf'(  AT)  —  n'vW'iX,.)  where  the  parameter  n  is  assumed  to  be  large 
and  represents  the  strength  of  the  nearly  rigid  constra-int.  The  main  problem 

i  IV..  C.  ;  I  V  i.  t  <<  V.  V_  i  i  /v  C  L.  ;  1  V_.  1  1  1  •  I  J  v.  V-y  *.  .  \  C  ’I.  >  t.  .  y  V./  I  I  I  »,  t.  C.  I  V.  j  I  Vw  I  i  i  ..J  i  ^...  ^  t  •  i  I  V..  1  C.»  I 

model  dXn  =  di]r,  -  nVil'(A„)  vs’here  {z/^}  is  a  sequence  of  semimartingales. 
For  exaniole.  rj-  might  be  given  by  dn^  =  a(X~)d\\'  —  Xb  (X-^dt  where  W 
is  standard  Brownian  motion.  The  classical  limit  results  are  extended  to  the 
stochastic  setting  and  ways  of  exploiting  the  stochasticity  to  avoid  some  of 


f  lo 
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problems  of  the  deterministic  setting  are  explored. 


Alexander  D.  Wentzell 
Department  of  Mathematics 
Tulane  University 
New  Orleans,  LA  70118 

Asymptotic  expansions  in  limit  theorems  for  stochastic  processes 


For  some  families  of  stochastic  processes  0  <  i  <  2  .  one  can  prove 

IiiiiiL  ihcoiciiis  on  Weak  cuuwrgeuce; 


f:f’(,r|0,7’|)  =  £;F(,"(0,r|)  +  o(i) 
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as  e  I  0  for  all  bounded  continuous  functionals  F.  One  can  try  to  find 
asymptotic  expansions  for  o(l)  for  some  narrower  classes  of  functionals; 

EF{t]^[0,  T])  =  EF{rj^[0,T])  +  k{e)Ci  +  . . .  +  +  o(A;(e)'"), 

where  k{e)  0  (e  i  0).  Some  theorems  of  this  kind  have  been  obtained,  and 
in  them  the  coefficients  C;  are  expressed  in  the  form 

C,  =  /f.EF(40,T]), 

where  A,  are  linear  operators  acting  on  functionals  that  are  expressed  in 
terms  of  characteristics  of  the  stochastic  processes  t]^;  in  some  natural  classes 
of  cases,  infinite-dimensional  differential  operators. 

Possible  applications  to  Monte-Carlo  computation  are  described. 


Debasis  Mitra 
AT&T  Bell  Laboratories 
MH-2C-125 

A/T  -TTMl  ATT  r\  ^  J 

x  •.i.ii.  i  ’*  o  i  v  i  ~x 

Some  recent  directions  in  the  analysis  of  high-speed 
communication  networks 


The  talk  will  review  recent  results  on  (i)  stochastic  fluid  models  for  burst- 
scale  effects  in  ATM,  (ii)  loss  and  service  priority  systems,  (iii)  admission  con¬ 
trol  and,  time  permitting,  (iv)  feedback-based  adaptive  allocation  of  band¬ 
width. 


Martin  I.  Reiman 

AT&T  Bell  Laboratories,  RM  2C-117 

600  Mountain  Ave. 

Murray,  NJ  07974 

Some  observations  on  scaling  for  Markov  modulated  cpieues  in 

heavy  traffic 
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Queues  with  Markov  modulated  input,  where  the  arrival  rate  depends 
on  the  state  of  a  “background"  Markov  process,  are  of  practical  interest  in 
communications  systems,  where  the  state  of  the  background  Markov  process 
is  the  number  of  active  sources.  The  most  common  input  process  models  in 
this  context  (given  the  state  of  the  background  process)  are  a  deterministic 
“fluid”  or  a  Poisson  process.  Although  much  has  been  done  in  the  area  of 
obtaining  efficient  numerical  solutions  for  these  models,  there  is  still  an  in¬ 
terest  in  asymptotics.  One  particular  asymptotic  regime  that  has  received  a 
lot  of  attention  is  heavy  traffic,  where  the  average  arrival  rate  is  close  to  the 
service  rate.  Since  there  are  many  parameters  in  this  model,  there  are  many 
ways  to  achieve  heavy  traffic.  For  example,  the  number  of  “sources”  can 
remain  fixed  or  grow  to  infinity.  The  achievable  limit  processes  include;  re¬ 
flected  Brownian  motion,  (finite  state)  Markov  modulated  Brownian  motion, 
Ornstein-Uhlenbeck  modulated  fluid,  and  Orstein-Uhlenbeck  modulated  re¬ 
flected  Brownian  motion.  We  describe  each  of  these  limits  and  the  parameter 
scalings  which  give  rise  to  them. 


P.  R.  Kumar 
University  of  Illinois 
Coordinated  Science  Laboratory 

1308  West  Main  Street 
Urbana, IL  61801 

Scheduling  queueing  networks:  Stability,  performance  analysis 

and  design 

Queueing  networks  are  a  useful  class  of  models  in  many  application  do¬ 
mains,  e.g.,  manufacturing  systems,  communication  networks,  and  computer 
SN'stems.  Control  is  typically  exercised  over  such  systems  by  the  use  of 
scheduling  policies. 

However,  if  one  ventures  outside  a  certain  special  class  of  sy'stems  for 
which  the  steady  state  distribution  has  a  product  form,  vcr\-  little  is  known 
concerning  their  performance  or  even  stability.  In  the  first  half  of  talk,  we 
present  new  theoretical  developments  on  stability  analysis  and  pertormance 
evaluation  for  queueing  networks  and  scheduling  policies.  In  the  second  hall. 
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we  address  the  problem  of  scheduling  a  class  of  queueing  netwoiks  called  le- 
entrant  lines  which  model  semiconductor  manufacturing  plants.  We  propose 
a  new  class  of  efficient  scheduling  policies  based  on  smoothing  all  the  flows 
in  the  system. 


Moshe  Zakai 

Electrical  Engineering  Department 

Technion  —  I.  I.  T. 

Haifa  32000,  Israel 

Some  bounds  on  the  filtering  error  in  nonlinear  filtering 

The  first  part  of  the  talk  will  be  devoted  to  a  general  introduction  to 
Wiener.  Kalman-Bucy  and  nonlinear  filtering.  The  main  results  for  the  opti¬ 
mal  filter  and  the  associated  minimal  mean  squared  error  will  be  discussed. 
The  second  part  will  be  devoted  to  the  presentation  of  a  bounding  technique 
for  the  lower  bounding  of  the  filtering  error  and  a  particular  case  will  be 
evaluated  explicitly. 


Rafail  Khasminskii 
Department  of  Mathematics 

Wayne  State  University 
Detroit,  MI  48202 

Some  robustness  problems  in  stability  of  stochastic  differential 

equations. 

The  problems  of  robustness  of  asymptotic  stability,  instability,  Lyapunov 
exponents  and  stability  index  for  linear  and  homogeneous  of  degree  one 
stochastic  differential  equations  with  respect  to  small  nonlinear  perturba¬ 
tions  of  coefficients  are  considered.  Sufficient  conditions  for  the  robustness 
of  stability  index  are  proposed  in  particular. 
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Lennart  Ljung 
Linkoping  University 
Inst.  f.  Systemteknik 
S-581  83  Linkoping 
Sweden 

Tracking  ability  and  accelerated  convergence  in  adaptive 

algorithms 

Basic  stochastic  approximation  has  been  a  great  source  of  inspiration 
for  all  kinds  of  adaptative  and  tracking  algorithms  used  in  many  technical 
applications.  To  understand  and  develop  the  algorithms  it  is  necessary  to 
have  good  insight  into  their  performance  properties.  In  this  presentation  we 
will  overview  approaches  to  performance  analysis,  in  particular  the  ability 
of  different  algorithms  to  track  changing  phenomena.  This  includes  some 
quite  recent  results  with  explicit  expressions  and  bounds  for  the  performance 
measures. 

The  presentation  will  also  cover  some  aspects  of  the  recent  development 
in  accelerated  convergence  (with  a  ‘‘second  round  of  averaging").  The  focus 
is  here  on  whether  the  ability  to  track  changing  properties  is  also  improved 
in  a  similar  way. 


loannis  Karatzas 
Department  of  Statistics 

Columbia  University 
New  York,  NY  10027 

Dynamic  allocation  and  multi-armed  bandit  problems 

Recent  results  are  presented  on  the  optimality  of  Gittins  index-type  strate¬ 
gies  for  very  general  dynamic  allocation  problems  of  the  “multi-armed  ban¬ 
dit"  form,  in  both  discrete  and  continuous  time.  In  particular,  it  is  shown 
that  no  Markovian  assumptions  are  necessary,  and  that  the  independence 
conditions  on  the  evolution  of  the  different  projects  or  “arms"  can  be  relaxed 
considerably.  (This  is  joint  work  with  Professor  Nicole  El  Karoui.) 
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